Noise-Enhanced Associative Memories
نویسندگان
چکیده
Recent advances in associative memory design through structured pattern sets and graph-based inference algorithms allow reliable learning and recall of exponential numbers of patterns. Though these designs correct external errors in recall, they assume neurons compute noiselessly, in contrast to highly variable neurons in hippocampus and olfactory cortex. Here we consider associative memories with noisy internal computations and analytically characterize performance. As long as internal noise is less than a specified threshold, error probability in the recall phase can be made exceedingly small. More surprisingly, we show internal noise actually improves performance of the recall phase. Computational experiments lend additional support to our theoretical analysis. This work suggests a functional benefit to noisy neurons in biological neuronal networks.
منابع مشابه
Robust image retrieval from noisy inputs using lattice associative memories
Lattice associative memories also known as morphological associative memories are fully connected feedforward neural networks with no hidden layers, whose computation at each node is carried out with lattice algebra operations. These networks are a relatively recent development in the field of associative memories that has proven to be an alternative way to work with sets of pattern pairs for w...
متن کاملBipolar spectral associative memories
Nonlinear spectral associative memories are proposed as quantized frequency domain formulations of nonlinear, recurrent associative memories in which volatile network attractors are instantiated by attractor waves. In contrast to conventional associative memories, attractors encoded in the frequency domain by convolution may be viewed as volatile online inputs, rather than nonvolatile, off-line...
متن کاملIncreasing the Robustness of Heteroassociative Morphological Memories for Practical Applications
Associative Morphological Memories are a recently proposed neural networks architecture based on the shift of the basic algebraic framework. They possess some robustness to specific noise models (erosive and dilative noise). Combining the Associative Morphological Memories with erosion/dilation scale-spaces, we achieved an increased robustness against noise. Here we report ongoing work on their...
متن کاملOn the Recall Capability of Recurrent Exponential Fuzzy Associative Memories Based on Similarity Measures
Recurrent exponential fuzzy associative memories (RE-FAMs) are non-distributive memory models derived from the multivalued exponential recurrent associative memory (MERAM) of Chiueh and Tsai. A RE-FAM defines recursively a sequence of fuzzy sets obtained by a weighted average of the fundamental memories. In this paper, we show that the output of a single-step RE-FAM can be made as close as desi...
متن کاملNo Rounding Reverse Fuzzy Morphological Associative Memories
The fuzzy morphological associative memories (FMAM) have many attractive advantages, but their recall effects for hetero associative memories are poor. This shortcoming impedes the application of hetero-FMAM. Aiming at the problem, and inspired by the unified framework of morphological associative memories, a new method called no rounding reverse fuzzy morphological associative memories (NRFMAM...
متن کامل